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Foreword 



This technical report provides results of an analysis of unit response rates for the 
components of the 1993-94 Schools and Staffing Surveys (SASS). The study was motivated by 
the general need to continually evaluate and improve the quality of SASS data, and more 
specifically to identify potential sources of nonsampling error associated with nonresponse in 



SASS. 



The report will be of interest to users of SASS data, to persons responsible for various 
aspects of the design and operation of the SASS surveys, and to anyone interested in the quality 
of survey data, especially data from mail surveys and surveys related to education. 

As background, the report describes the survey design and nonresponse adjustment 
procedures for each of the components of SASS. A primary focus of the analysis is to compare 
the response rates for known characteristics of schools, administrators, teachers, school districts, 
libraries, librarians, and student records, and to assess the extent and pattern of these differences. 
Where possible, findings from the 1993-94 analysis are compared to results from an earlier 
companion report, An Exploratory Analysis of Response Rates in the 1990-91 Schools and 
Staffing Surveys (SASS) (Scheuren, Monaco, Zhang, Ikosi, Chang, and Gruber, 1996). In 
addition, due to the multi-stage sample design of SASS, the hierarchical nature of response rates 
is examined with interesting results. Finally, a multivariate model of unit response is developed 
for one of the SASS components to explain the relationship between these factors to the level of 
unit response. 



Paul Planchon 

Associate Commissioner 

Surveys and Cooperative Systems Group 



Daniel Kasprzyk 
Program Director 
Education Surveys 



SASS Methodological Papers and Reports Reference List 



Bushery, J., Royce, D., and Kasprzyk, D. (1992). “The Schools and Staffing Survey: How 
Reinterview Measures Data Quality.” In Schools and Staffing Survey (SASS) Papers 
Presented at Meetings of the American Statistical Association, pp. 7-12. NCES Working 
Paper No. 94-01. Washington, D.C.: National Center for Education Statistics. 

Chaney, B. (1994). The Accuracy of Teachers ’ Self-Reports on their Postsecondary Education: 
Teacher Transcript Study, Schools and Staffing Survey. NCES Working Paper No. 94- 
04. U.S. Department of Education, Office of Educational Research and Improvement, 
National Center for Education Statistics. Washington, D.C.: National Center for 
Education Statistics. 

Cole, C., Parmer, R., and Schwanz, D. (1997). Improving the Mail Return Rates of SASS 

Surveys: A Review of the Literature. NCES Working Paper No. 97-18. U.S. Department 
of Education, Office of Educational Research and Improvement, National Center for 
Education Statistics. Washington, D.C.: National Center for Education Statistics. 

Fink, S. (1994). Schools and Staffing Survey 1990-91: SASS Cross-Questionnaire Analysis. 

NCES Working Paper No. 95-03. U.S. Department of Education, Office of Educational 
Research and Improvement, National Center for Education Statistics. Washington, D.C.: 
National Center for Education Statistics. 

Holt, A. and Scanlon, B. (1994). QED Estimates of the 1990-91 Schools and Staffing Survey: 
Deriving and Comparing QED School Estimates with CCD Estimates. NCES Working 
Paper 95-02. U.S. Department of Education, Office of Educational Research and 
Improvement, National Center for Education Statistics. Washington, D.C.: National 
Center for Education Statistics. 

Isaacs, J., Garet, M., and Sherman, J. (1997). Collection of Private School Finance Data: 

Development of a Questionnaire. NCES Working Paper No. 97-22. U.S. Department of 
Education, Office of Educational Research and Improvement, National Center for 
Education Statistics. Washington, D.C.: National Center for Education Statistics. 

Jabine, T. (1994). Quality Profile for SASS: Aspects of the Quality of Data in the Schools and 
Staffing Surveys (SASS). NCES 94-340. U.S. Department of Education, Office of 
Educational Research and Improvement, National Center for Education Statistics. 
Washington, D.C.: Government Printing Office. 

Jackson, B. and Frazier, R. (1996). Improving the Coverage of Private Elementary-Secondary 
Schools. NCES Working Paper No. 96-26. U.S. Department of Education, Office of 
Educational Research and Improvement, National Center for Education Statistics. 
Washington, D.C.: National Center for Education Statistics. 



O 

ERIC 



IV 



6 



Jenkins, C. (1992). “Questionnaire Research in the Schools and Staffing Survey: A Cognitive 
Approach.” In Schools and Staffing Survey (SASS) Papers Presented at Meetings of the 
American Statistical Association, pp. 19-24. NCES Working Paper No. 94-01. 
Washington, D.C.: National Center for Education Statistics. 

Jenkins, C. (1997). Report of Cognitive Research on the Public and Private School Teacher 
Questionnaires for the Schools and Staffing Survey 1993-94 School Year. NCES 
Working Paper No. 97-10. U.S. Department of Education, Office of Educational 
Research and Improvement, National Center for Education Statistics. Washington, D.C.: 
National Center for Education Statistics. 

and Von Thum, D. (1996). Cognitive Research on the Teacher Listing Form for the 

Schools and Staffing Survey. NCES Working Paper No. 96-05. U.S. Department of 
Education, Office of Educational Research and Improvement, National Center for 
Education Statistics. Washington, D.C.: National Center for Education Statistics. 

Kasprzyk, D., Gruber, K., Salvucci, S., Saba, M., Zhang, F., and Fink, S. (1994). “Some Data 
Issues in School-Based Surveys.” In Schools and Staffing Survey (SASS): 1994 Papers 
Presented at the 1994 Meeting of the American Statistical Association, pp. 32-37. NCES 
Working Paper No. 95-01 . U.S. Department of Education, Office of Educational 
Research and Improvement, National Center for Education Statistics. Washington, D.C.: 
National Center for Education Statistics. 

Kaufman, S. (1992). “Balanced Half-Sample Replication with Aggregation Units.” In Schools 
and Staffing Survey (SASS) Papers Presented at Meetings of the American Statistical 
Association, pp. 25-30. NCES Working Paper No. 94-01. U.S. Department of 
Education, Office of Educational Research and Improvement, National Center for 
Education Statistics. Washington, D.C.: National Center for Education Statistics. 

. (1993). “A Bootstrap Variance Estimator for the Schools and Staffing Survey.” In 

Schools and Staffing Survey (SASS) Papers Presented at Meetings of the American 
Statistical Association, pp. 74-79. NCES Working Paper No. 94-01. U.S. Department of 
Education, Office of Educational Research and Improvement, National Center for 
Education Statistics. Washington, D.C.: National Center for Education Statistics. 

. (1994). “Properties of the Schools and Staffing Survey’s Bootstrap Variance 

Estimator.” In Schools and Staffing Survey (SASS): 1994 Papers presented at the 1994 
Meeting of the American Statistical Association, pp. 12-23. NCES Working Paper No. 
95-01. U.S. Department of Education, Office of Educational Research and Improvement, 
National Center for Education Statistics. Washington, D.C.: National Center for 
Education Statistics. 



• (1997). “Estimating the Variance in the Presence of Imputation Using a Residual.” 

In Selected Papers on Education Surveys: Papers Presented at the 1996 Meeting of the 
American Statistical Association, pp. 45-50. NCES Working Paper 97-0 1 . U.S. 
Department of Education, Office of Educational Research and Improvement, National 
Center for Education Statistics. Washington, D.C.: National Center for Education 
Statistics. 

Li, B. and Scheuren, F. (1996). “Improved GLS Estimation in NCES Surveys.” NCES Working 
Paper No. 96-02. U.S. Department of Education, Office of Educational Research and 
Improvement. Washington, D.C.: National Center for Education Statistics. 

Mullens, J. and Kasprzyk, D. (1996). The Schools and Staffing Survey: Recommendations for 
the Future. Conference Proceedings. NCES 97-596. U.S. Department of Education, 
Office of Educational Research and Improvement, National Center for Education 
Statistics. Washington, D.C.: Government Printing Office. 

Parmer, R., Shen, P-S., and Tan, A. (1992). “Mail Versus Telephone Response in the 1990-91 
Schools and Staffing Surveys.” In Schools and Staffing Survey (SASS) Papers Presented 
at Meetings of the American Statistical Association, pp. 13-18. NCES Working Paper 
No. 94-01 . U.S. Department of Education, Office of Educational Research and 
Improvement, National Center for Education Statistics. Washington, D.C.: National 
Center for Education Statistics. 

Royce, D. (1994). “The Results of the 1993 Teacher List Validation Study (TLVS).” In Six 
Papers on Teachers from tfie 1990-91 Schools and Staffing Survey and Other Related 
Surveys. NCES Working Paper No. 94-06. U.S. Department of Education, Office of 
Educational Research and Improvement, National Center for Education Statistics. 
Washington, D.C.: National Center for Education Statistics. 

Salvucci, S., Weng, S., and Kaufman, S. (1995). Design Effects and Generalized Variance 
Functions for the 1990-91 Schools and Staffing Survey (SASS). NCES 95-342. U.S. 
Department of Education, Office of Educational Research and Improvement, National 
Center for Education Statistics. Washington. D.C.: National Center for Education 
Statistics. 

Salvucci, S., Walter, E., Conley, V., Fink, S., Saba, M., and Kaufman, S. (1997). Measurement 
Error Studies at the National Center for Education Statistics. NCES 97-464. U.S. 
Department of Education, Office of Educational Research and Improvement, National 
Center for Education Statistics. Washington, D.C.: Government Printing Office. 

Scheuren, F. and Li, B. (1995). Intersurvey Consistency in NCES Private School Surveys. 

NCES Working Paper No. 95-16. U.S. Department of Education, Office of Educational 
Research and Improvement, National Center for Education Statistics. Washington, D.C.: 
National Center for Education Statistics. 



O 

ERIC 



vi 



8 



Scheuren, F. and Li, B. (1996). Intersurvey Consistency in NCES Private School Surveys for 
1993-94. NCES Working Paper No. 96-27. U.S. Department of Education, Office of 
Educational Research and Improvement, National Center for Education Statistics. 
Washington, D.C.: National Center for Education Statistics. 

Shen, P-S., and Fisher, R. (1993). “Adjusting for Nonresponse Bias of Correlated Items Using 
Logistic Regression.” In Schools and Staffing Survey, (SASS) Papers Presented at 
Meetings of the American Statistical Association, pp. 80-84. NCES Working Paper No. 
94-01. U.S. Department of Education, Office of Educational Research and Improvement, 
National Center for Education Statistics. Washington, D.C.: National Center for 
Education Statistics. 

, Parmer, R., and Tan, A. (1992). “Characteristics of Nonrespondents in the Schools 

and Staffing Surveys’ School Sample.” In Schools and Staffing (SASS) Papers Presented 
at Meetings of the American Statistical Association, pp. 31-36. NCES Working Paper 
94-01. U.S. Department of Education, Office of Educational Research and Improvement, 
National Center for Education Statistics. Washington, D.C.: National Center for 
Education Statistics. 

Smith, W., Ghosh, D., and Chang, M. (1995). “Optimal Periodicity of a Survey: Alternatives 
under Cost and Policy Constraints.” In Schools and Staffing Survey (SASS): 1995 
Selected papers presented at the 1995 Meeting of the American Statistical Association, 
pp. 29-34. NCES Working Paper No. 96-02. U.S. Department of Education, Office of 
Educational Research and Improvement, National Center for Education Statistics. 
Washington, D.C.: National Center for Education Statistics. 

Smith, W., Ghosh, D., and Chang, M. (1997). Optimal Choice of Periodicities for the Schools 
and Staffing Survey: Modeling and Analysis. NCES Working Paper No. 97-14. U.S. 
Department of Education, Office of Educational Research and Improvement, National 
Center for Education Statistics. Washington, D.C.: National Center for Education 
Statistics. 

Zukerberg, A. and Lee, M. (1997). Further Cognitive Research on the Schools and Staffing 
Survey (SASS) Teacher Listing Form. NCES Working Paper No. 97-23. U.S. 

Department of Education, Office of Educational Research and Improvement, National 
Center for Education Statistics. Washington, D.C.: National Center for Education 
Statistics. 




9 

Vll 



Acknowledgments 



The authors express their sincere thanks to all those who contributed to the production of 
this report. From the National Center for Education Statistics (NCES), special thanks goes to our 
project officer, Kerry Gruber, who provided guidance from beginning to end, as well as Dan 
Kasprzyk and Steven Kaufman, who provided additional technical guidance and reviewed each 
draft of the report. In addition, we would like to thank Marilyn McMillen of NCES for her 
valuable pre-adjudication review of the report. Michael P. Cohen, Statistical Standards and 
Services Group, NCES, chaired the adjudication committee and provided extensive and useful 
comments. 

We would also like to extend grateful thanks to all of the adjudication reviewers: Tai 
Phan and Ralph Lee of NCES, and Randy Parmer and Patrick E. Healy of the U.S. Bureau of the 
Census. 

At Synectics, Elizabeth Walter and Stephen Wenck assisted greatly in the preparation of 
the final version of the report. 



Table of Contents 



Table of Contents 

Foreword 

Acknowledgments 

Tables 

Figures 



.... iii 
.. viii 
... xii 
xviii 



Chapter 1 

Overview 

1 . 1 Introduction 

1 .2 Structure of the Report 

1.3 Overview of the 1993-94 SASS Design 

1.4 Overview of Data Collection Procedures for the 1993-94 SASS 

1.5 Item Response Rates in the 1993-94 SASS 

1.6 Overview of Nonresponse Adjustment Procedures 

1.7 Unit Response Rates 



Chapter 2 

SASS Core Components 

2.1 Introduction 

2.2 SASS School Component 

2.2.1 Public School Component 

2.2.2 Private School Component 

2.3 SASS Administrator Component 

2.3.1 Public Administrator Component 

2.3.2 Private Administrator Component 

2.4 SASS Teacher Component 

2.4.1 Public School Teacher Component 

2.4.2 Private School Teacher Component 

2.5 SASS Teacher Demand and Shortage Component 



19 

19 

20 
21 
.32 
.43 
,44 
,54 
.63 
.67 
.77 
.85 



1993-94 SASS Nonresponse Analysis 



Chapter 3 



New SASS Components 97 

3.1 Introduction 97 

3.2 SASS Library /Media Center Component 98 

3.2.1 Public School Library/Media Center Component 99 

3.2.2 Private School Library/Media Center Component 110 

3.3 SASS Librarian Component 120 

3.3.1 Public School Librarian Component 120 

3.3.2 Private School Librarian Component 130 

3.4 SASS Student Record Component 138 

3.4.1 Public School Student Record Component 142 

3.4.2 Private School Student Record Component 149 



Chapter 4 

Summary of Significance Tests 157 



Chapter 5 



Hierarchical and Cross-Classified Testing 163 

5.1 Introduction 163 

5.2 Test Results by Survey Component 163 

5.2.1 Public Components 163 

5.2.2 Private Components 170 

5.3 Summary of Test Results Across Components 176 



Chapter 6 



Measurement of the Sampling Frame and Cooperation Rates 177 

6.1 Introduction 177 

6.2 Out-of-Scope Rates 177 

6.3 Reasons for Nonresponse 180 

6.4 Cooperation Rate 183 

6.5 Differences in Respondents versus Nonrespondents After Removal of 

Unable-To-Contacts 1 85 



12 

o 

ERLC 



X 



Table of Contents 



Chapter 7 

Nonresponse Modeling for the Public School Component 189 

7.1 Introduction 189 

7.2 Model Selection 189 

7.3 Final Logistic Regression Models for the Public School Components 190 

7.4 Discussion 195 

Chapter 8 

Highlights and Recommendations 197 

Glossary G-l 

References R-l 

Appendices 
Appendix A 

Response Rate Tables A-l 

Appendix B 

Tests of Associations Between Response Status and Characteristics B-l 



1993-94 SASS Nonresponse Analysis 



Tables 

(By chapter or component) 

Chapter 1 

Table 1.4.1 -- Data collection time schedule 6 

Table 1.4.2 -- Second mailing of questionnaires 9 

Table 1.4.3 — Computer-assisted telephone interviewing (CATI) follow-up of mail 

nonresponses 10 

Table 1.4.1 - Telephone follow-up of mail nonresponses by field representatives 10 

Table 1.5.1 -- Unweighted item response rates by questionnaire 13 

Table 1.5.2 — Items with response rates of less than 75 percent 14 

Table 1.7.1 -- Unweighted and weighted response rates compared 17 

Public School Component 

Table 2.2.1 -- Nonresponse adjustment procedures for Public School Survey 22 

Table 2.2.2 — Ten highest and lowest weighted response rates by state: Schools and Staffing 

Survey 1993-94, Public School Component 24 

Table 2.2.3 -- Significance test results: Schools and Staffing Survey 1993-94, Public School 
Component 30 

Private School Component 

Table 2.2.4 -- Nonresponse adjustment procedures for Private School and Administrator 

Surveys 34 

Table 2.2.5 -- Weighted stratum response rates: Schools and Staffing Survey 1993-94, Private 

School Component 35 

Table 2.2.6 -- Significance test results: Schools and Staffing Survey 1993-94, Private School 
Component 41 

Public School Administrator Component 

Table 2.3.1 — Ten highest and lowest weighted response rates by state: Schools and Staffing 

Survey 1993-94, Public School Administrator Component 45 

Table 2.3.2 -- Significance test results: Schools and Staffing Survey 1993-94, Public School 
Administrator Component 52 

Private School Administrator Component 

Table 2.3.3 — Weighted stratum response rates: Schools and Staffing Survey 1993-94, Private 

School Administrator Component 55 

Table 2.3.4 -- Significance test results: Schools and Staffing Survey 1993-94, Private School 
Administrator Component 61 



Tables 



Public and Private School Teacher Components 

Table 2.4.1 — Nonresponse adjustment procedures for Teacher Surveys 66 



Public School Teacher Component 

Table 2.4.2 — Ten highest and lowest weighted response rates by state: Schools and Staffing 
Survey 1993-94, Public School Teacher Component 68 

Table 2.4.3 - Significance test results: Schools and Staffing Survey 1993-94, Public School 
Teacher Component 74 

Private School Teacher Component 

Table 2.4.4 ~ Weighted stratum response rates: Schools and Staffing Survey 1993-94, Private 
School Teacher Component 78 

Table 2.4.5 - Significance test results: Schools and Staffing Survey 1993-94, Private School 
Teacher Component 83 

Public Teacher Demand and Shortage Component 

Table 2.5.1 — Nonresponse adjustment procedures for Teacher Demand and Shortage Survey.. .87 

Table 2.5.2 - Ten highest and lowest weighted response rates by state: Schools and Staffing 
Survey 1993-94, Public Teacher Demand and Shortage Component 89 

Table 2.5.3 - Significance test results: Schools and Staffing Survey 1993-94, Public Teacher 
Demand and Shortage Component 95 

Public School Library and Librarian Components 

Table 3.2.1 - Nonresponse adjustment procedures for Public Library and Librarian Surveys... 100 



Public School Library Component 

Table 3.2.2 -- Ten highest and lowest weighted response rates by state: Schools and Staffing 

Survey 1993-94, Public School Library Component 102 

Table 3.2.3 — Significance test results: Schools and Staffing Survey 1993-94, Public School 
Library Component 108 

Private School Library and Librarian Components 

Table 3.2.4 — Nonresponse adjustment procedures for the Private School Library and Librarian 
Surveys 1 1 1 




xiii 



It) 



1993-94 SASS Nonresponse Analysis 



Private School Library Component 

Table 3.2.5 — Weighted 3-level typology response rates: Schools and Staffing Survey 1993-94, 
Private School Library Component 1 13 

Table 3.2.6 — Significance test results: Schools and Staffing Survey 1993-94, Private School 
Library Component 118 

Public School Librarian Component 

Table 3.3.1 — Ten highest and lowest weighted response rates by state: Schools and Staffing 
Survey 1993-94, Public School Librarian Component 122 

Table 3.3.2 — Significance test results: Schools and Staffing Survey 1993-94, Public School 
Librarian Component 128 

Private School Librarian 

Table 3.3.3 — Weighted 3-level typology response rates: Schools and Staffing Survey 1993-94, 
Private School Librarian Component 131 

Table 3.3.4 — Significance test results: Schools and Staffing Survey 1993-94, Private School 
Librarian Component 136 

Public and Private School Student Record Components 

Table 3.4.1 — Nonresponse adjustment procedures for Student Surveys 141 

Public School Student Record Component 

Table 3.4.2 — Significance test results: Schools and Staffing Survey 1993-94, Public School 
Student Record Component 147 

Private School Student Record Component 

Table 3.4.3 — Significance test results: Schools and Staffing Survey 1993-94, Private School 
Student Record Component 154 



Tables 



Chapter 4 

Table 4.1 — Public component significance test results: Schools and Staffing Survey 1993-94, 

Public Administrator, School, Teacher, Library, Librarian, and Student Components 157 

Table 4.2 — Private component significance test results: Schools and Staffing Survey 1993-94, 

Private Administrator, School, Teacher, Library, Librarian, and Student Components 158 

Table 4.3 — Public component response rate ranks: Schools and Staffing Survey 1993-94, Public 

Administrator, School, Teacher, Library, Librarian, and Student Components 160 

Table 4.4 — Private component response rate ranks: Schools and Staffing Survey 1993-94, 

Private Administrator, School, Teacher, Library, Librarian, and Student Components 161 



Chapter 5 

Table 5.2.1 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, Public 

School Administrator Component 164 

Table 5.2.2 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, Public 

School Component 165 

Table 5.2.3 - Hierarchical significance test results: Schools and Staffing Survey 1993-94, Public 

School Teacher Component 166 

Table 5.2.4 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, Public 

School Library Component 1 67 

Table 5.2.5 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, Public 

School Librarian Component 168 

Table 5.2.6 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, Public 

School Student Record Component 169 

Table 5.2.7 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, 

Private School Administrator Component 170 

Table 5.2.8 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, 

Private School Component 171 

Table 5.2.9 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, 

Private School Teacher Component 172 

Table 5.2.10 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, 

Private School Library Component 173 

Table 5.2.1 1 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, 

Private School Librarian Component 174 

Table 5.2.12 — Hierarchical significance test results: Schools and Staffing Survey 1993-94, 

Private School Student Record Component 175 

Table 5.3.1 — Public and private component hierarchical results: Schools and Staffing Survey 
1993-94, All components except the Public Teacher Demand and Shortage Component.... 176 




XV 




1993-94 SASS Nonresponse Analysis 



Chapter 6 

Table 6.2.1 - Definition of out-of-scope units in the 1993-94 Schools and Staffing Survey 178 

Table 6.2.2 - Out-of-scope sampled units as a percentage of the total sample: Schools and 

Staffing Survey, 1993-94 179 

Table 6.3. 1 - Reasons for nonresponse expressed as a percentage of total sample size: Schools 

and Staffing Survey 1993-94 181 

Table 6.3.2 — Reasons for nonresponse expressed as a percentage of nonrespondents: Schools 

and Staffing Survey 1993-94 182 

Table 6.4.1 — Weighted cooperation and response rates: Schools and Staffing Survey 

1993-94 184 

Table 6.5.1 — Rao-Scott3 P-value: Schools and Staffing Survey 1993-94, Public School Teacher 

Component 185 

Table 6.5.2 — Weighted response and cooperation rates: Schools and Staffing Survey 1993-94, 

Public School Teacher Component 186 

Table 6.5.3 — Rao-Scott3 P-value: Schools and Staffing Survey 1993-94, Private School 

Teacher Component 186 

Table 6.5.4 — Weighted response and cooperation rates: Schools and Staffing Survey 1993-94, 
Private School Teacher Component 187 



Chapter 7 

Table 7.3.1 — P-values for Rao-Scott, univariate logistic regression model, and multivariate 

logistic regression model tests 191 

Table 7.3.2 — Parameter estimate, odds ratio and P-value: Schools and Staffing Survey 1993-94, 

Public School Component 193 

Table 7.3.3 -- The reduced model with insignificant variables eliminated 195 



Chapter 8 

Table 8.1 — CATI/telephone follow-up completion rates: Schools and Staffing Survey 1993-94, 
Public and Private School, Administrator, Teacher, Library, and Librarian Components. ..198 
Table 8.2 -- Unit response rates: Schools and Staffing Survey 1987-88, 1990-91, and 1993-94, 



Public and Private School, Administrator, and Teacher Components 200 

Table 8.3 — Unit response rates: Schools and Staffing Survey 1993-94, Public and Private 

Library, Librarian, and Student Record Components 200 

Table 8.4 — Regional response rates: Schools and Staffing Survey 1990-91 and 1993-94, Public 

and Private School, Administrator, and Teacher Components 202 

Table 8.5 — Urbanicity response rates: Schools and Staffing Survey 1990-91 and 1993-94, 

Public School, Administrator, and Teacher Components 203 

Table 8.6 — School size response rates: Schools and Staffing Survey 1990-91 and 1993-94, 

Public School, Administrator, and Teacher Components 204 



Tables 



Table 8.7 — Metropolitan statistical area response rates: Schools and Staffing Survey 1990-91 

and 1993-94, Teacher Demand and Shortage component 205 

Table 8.8 — Urbanicity response rates: Schools and Staffing Survey 1990-91 and 1993-94, 

Private School, Administrator, and Teacher Components 206 

Table 8.9 — School size response rates: Schools and Staffing Survey 1990-91 and 1993-94, 

Private School, Administrator, and Teacher Components 207 

Table 8.10 — School level response rates: Schools and Staffing Survey 1990-91 and 1993-94, 

Public and Private School, Administrator, and Teacher Components 208 

Table 8.1 1 — Response rates for schools and administrators which did or did not submit a teacher 
listing form: Schools and Staffing Survey 1993-94, Public School and Administrator 

Components 210 

Table 8.12 — Response rates for 1993-94 Schools and Staffing Survey components which did or 

did not respond to the 1991-92 Private School Survey 210 

Table 8.13 — Response rates for all private school components which were or were not sampled 
in the 1990-91 Schools and Staffing Survey: Schools and Staffing Survey 1993-94, Private 
School, Administrator, Library, Librarian, and Student Record Components 211 



ERIC 



XVII 



•a 

i. 



1993-94 SASS Nonresponse Analysis 



Figures 

(By chapter or component) 

Chapter 1 

Figure 1.1 — Sample selection and data collection procedures for the 1993-94 Schools and 

Staffing Survey 4 

Public and Private School Components 

Figure 2.2.1 — Weighted response rate comparison for the Public and Private School 

Components: Schools and Staffing Survey 1987-88, 1990-91, and 1993-94 20 

Public School Component 

Figure 2.2.2 — Regional response rates: SASS 1990-91 versus SASS 1993-94, Public School 

Component 23 

Figure 2.2.3 — Weighted response rates for Public Schools: Schools and Staffing Survey 1993- 

94, Public School Component 25 

Figure 2.2.4 — Urbanicity response rates: SASS 1990-91 versus SASS 1993-94, Public School 

Component 26 

Figure 2.2.5— School level response rates: SASS 1990-91 versus SASS 1993-94, Public School 

Component 27 

Figure 2.2.6— School size response rates: SASS 1990-91 versus SASS 1993-94, Public School 
Component 28 

Private School Component 

Figure 2.2.7 — Region response rates: SASS 1990-91 versus SASS 1993-94, Private School 

Component 36 

Figure 2.2.8 — Urbanicity response rates: SASS 1990-91 versus SASS 1993-94, Private School 

Component 37 

Figure 2.2.9 — School level response rates: SASS 1990-91 versus SASS 1993-94, Private 

School Component 38 

Figure 2.2.10 — School size response rates: SASS 1990-91 versus SASS 1993-94, Private 

School Component 39 

Public and Private School Administrator Components 

Figure 2.3.1 - Weighted response rate comparison for the Public and Private Administrator 
Components: Schools and Staffing Survey 1987-88, 1990-91, and 1993-94 43 



xviii 



Figures 



Public School Administrator Component 

Figure 2.3.2 — Region response rates: SASS 1990-91 versus SASS 1993-94, Public School 

Administrator Component 46 

Figure 2.3.3 — Weighted response rates for Public Schools: Schools and Staffing Survey 1993- 

94, Public School Administrator Component 47 

Figure 2.3.4 — Urbanicity response rates: SASS 1990-91 versus SASS 1993-94, Public School 

Administrator Component 48 

Figure 2.3.5 — School level response rates: SASS 1990-91 versus SASS 1993-94, Public School 

Administrator Component 49 

Figure 2.3.6 — School size response rates: SASS 1990-91 versus SASS 1993-94, Public School 
Administrator Component 50 

Private School Administrator Component 

Figure 2.3.7 — Region response rates: SASS 1990-91 versus SASS 1993-94, Private School 

Administrator Component 56 

Figure 2.3.8 — Urbanicity response rates: SASS 1990-91 versus SASS 1993-94, Private School 

Administrator Component 57 

Figure 2.3.9 — School level response rates: SASS 1990-91 versus SASS 1993-94, Private 

School Administrator Component 58 

Figure 2.3.10 — School size response rates: SASS 1990-91 versus SASS 1993-94, Private 

School Administrator Component 59 

Public and Private School Teacher Components 

Figure 2.4.1 — Weighted response rate comparison for the Public and Private Teacher 

Components: Schools and Staffing Survey 1987-88, 1990-91, and 1993-94 63 

Public School Teacher Component 

Figure 2.4.2 — Region response rates: SASS 1990-91 versus SASS 1993-94, Public School 

Teacher Component 67 

Figure 2.4.3 — Weighted response rates for Public Schools: Schools and Staffing Survey 1993- 

94, Public School Teacher Component 69 

Figure 2.4.4 -- Urbanicity response rates: SASS 1990-91 versus SASS 1993-94, Public School 

Teacher Component 70 

Figure 2.4.5 — School level response rates: SASS 1990-91 versus SASS 1993-94, Public School 

Teacher Component 71 

Figure 2.4.6 -- School size response rates: SASS 1990-91 versus SASS 1993-94, Public School 
Teacher Component 72 



1993-94 SASS Nonresponse Analysis 



Private School Teacher Component 

Figure 2.4.7 — Region response rates: SASS 1990-91 versus SASS 1993-94, Private School 

Teacher Component 77 

Figure 2.4.8 — Urbanicity response rates: SASS 1990-91 versus SASS 1993-94, Private School 

Teacher Component 79 

Figure 2.4.9 — School level response rates: SASS 1990-91 versus SASS 1993-94, Private 

School Teacher Component 80 

Figure 2.4.10 — School size response rates: SASS 1990-91 versus SASS 1993-94, Private 

School Teacher Component 81 



Public Teacher Demand and Shortage Component 

Figure 2.5.1 — Weighted response rate comparison for the Public Teacher Demand and Shortage 



Component: Schools and Staffing Survey 1987-88, 1990-91, and 1993-94 85 

Figure 2.5.2 — Region response rates: SASS 1990-91 versus SASS 1993-94, Public Teacher 

Demand and Shortage Component 88 

Figure 2.5.3 — Weighted response rates for Local Education Agencies: Schools and Staffing 

Survey 1993-94, Public Teacher Demand and Shortage Component 90 

Figure 2.5.4 — Metropolitan Statistical Area (MSA) response rates: SASS 1990-91 versus SASS 

1993-94, Public Teacher Demand and Shortage Component 91 

Figure 2.5.5 - Number of Schools in Local Education Agency (LEA) response rates: SASS 

1990-91 versus SASS 1993-94, Public Teacher Demand and Shortage Component 92 

Figure 2.5.6 — Number of Students in Local Education Agency (LEA) response rates: SASS 
1990-91 versus SASS 1993-94, Public Teacher Demand and Shortage Component 93 



Public and Private Library, Librarian, and Student Record Components 

Figure 3.1.1 — Overall response rate comparison for the new SASS components, the Public and 
Private Library, Librarian, and Student Components: Schools and Staffing Survey 
1993-94 98 

Public School Library Component 

Figure 3.2.1 — Region response rates: Schools and Staffing Survey 1993-94, Public School 

Library Component 101 

Figure 3.2.2 — Weighted response rates for Public Schools: Schools and Staffing Survey 1993- 

94, Public School Library Component 103 

Figure 3.2.3 — Urbanicity response rates: Schools and Staffing Survey 1993-94, Public School 

Library Component 104 

Figure 3.2.4 — School level response rates: Schools and Staffing Survey 1993-94, Public School 

Library Component 105 

Figure 3.2.5 -- School size response rates: Schools and Staffing Survey 1993-94, Public School 
Library Component 106 




XX 



22 



Figures 



Private School Library Component 

Figure 3.2.6 - Region response rates: Schools and Staffing Survey 1993-94, Private School 

Library Component 112 

Figure 3.2.7 — Urbanicity response rates: Schools and Staffing Survey 1993-94, Private School 

Library Component 114 

Figure 3.2.8 - School level response rates: Schools and Staffing Survey 1993-94, Private School 

Library Component 115 

Figure 3.2.9 - School size response rates: Schools and Staffing Survey 1993-94, Private School 
Library Component 116 

Public School Librarian Component 

Figure 3.3.1 - Region response rates: Schools and Staffing Survey 1993-94, Public School 

Librarian Component 121 

Figure 3.3.2 — Weighted response rates for Public Schools: Schools and Staffing Survey 1993- 

94, Public School Librarian Component 123 

Figure 3.3.3 - Urbanicity response rates: Schools and Staffing Survey 1993-94, Public School 

Librarian Component 124 

Figure 3.3.4 — School level response rates: Schools and Staffing Survey 1993-94, Public School 

Librarian Component 125 

Figure 3.3.5 — School size response rates: Schools and Staffing Survey 1993-94, Public School 
Librarian Component 126 

Private School Librarian Component 

Figure 3.3.6 — Region response rates: Schools and Staffing Survey 1993-94, Private School 

Librarian Component 130 

Figure 3.3.7 - Urbanicity response rates: Schools and Staffing Survey 1993-94, Private School 

Librarian Component 132 

Figure 3.3.8 - School level response rates: Schools and Staffing Survey 1993-94, Private School 

Librarian Component 133 

Figure 3.3.9 - School size response rates: Schools and Staffing Survey 1993-94, Private School 
Librarian Component 134 

Public School Student Record Component 

Figure 3.4.1 -- Region response rates: Schools and Staffing Survey 1993-94, Public School 

Student Record Component 142 

Figure 3.4.2 — Urbanicity response rates: Schools and Staffing Survey 1993-94, Public School 

Student Record Component 143 

Figure 3.4.3 - School level response rates: Schools and Staffing Survey 1993-94, Public School 

Student Record Component 144 

Figure 3.4.4 — School size response rates: Schools and Staffing Survey 1993-94, Public School 
Student Record Component 145 



O 

ERiC 



XXI 



1993-94 SASS Nonresponse Analysis 



Private School Student Record Component 

Figure 3.4.5 — Region response rates: Schools and Staffing Survey 1993-94, Private School 

Student Record Component 149 

Figure 3.4.6 — Urbanicity response rates: Schools and Staffing Survey 1993-94, Private School 

Student Record Component 150 

Figure 3.4.7 — School level response rates: Schools and Staffing Survey 1993-94, Private School 

Student Record Component 151 

Figure 3.4.8 — School size response rates: Schools and Staffing Survey 1993-94, Private School 
Student Record Component 1 52 




xxii 2 4 



Overview 



Chapter 1 
Overview 

The insidious thing about biases is their constancy and the consequent 
difficulty of detecting them. — W. Edwards Deming (1950) 

1.1 Introduction 

The 1993-94 Schools and Staffing Survey (SASS) is the third study of public and private 
elementary and secondary schools in a series of surveys begun in 1987-88 by the National Center 
for Education Statistics (NCES). 1 Survey data from schools, local education agencies (LEAs), 
administrators, and teachers in the United States were collected by mail with telephone follow-up 
of nonrespondents first during the 1987-88 school year and again during the 1990-91 and the 
1993-94 school years. The series provides data on school and teacher characteristics, school 
operations, programs and policies, teacher demand and supply, and the opinions and attitudes of 
teachers and school administrators about policies and working conditions. The analytic power of 
the data is enhanced by the ability to link survey data for individual LEAs, schools, 
administrators, and teachers. In 1993-94 new library, librarian, and student SASS components 
were initiated that could also be linked. In addition, computer assisted telephone interviewing 
(CATI) facilities were introduced for the first time during the 1993-94 SASS and were used 
extensively for nonresponse follow-up. 

This study is part of a systematic effort by NCES to evaluate the quality of SASS and as 
such this report is designed to enable users to understand the limitations of the 1993-94 SASS 
data and to provide managers information for planning future rounds of SASS. A comprehensive 
analysis of response rates for the 1990-91 SASS is found in a companion report by Scheuren, 
Monaco, Zhang, Ikosi, Chang, and Gruber (1996). A number of other reports have also been 
issued as part of the SASS quality review, notably Jabine (1994). 

Results from SASS are affected by two sources of error: sampling error and nonsampling 
error. Sampling errors are the result of basing survey estimates on a sample rather than all units 
in the population of interest and are published for selected estimates in all reports based on SASS 
data. 2 In addition, generalized variance functions which provide approximations of sampling 
errors for all SASS estimates are provided. 3 The other source of error is called nonsampling 
error, and includes all errors that are not due to sampling. 



1 The U.S. Bureau of the Census carries out the main survey operations for SASS -- including sample selection, data 
collection, and data processing — under an interagency agreement, according to specifications provided by NCES. 

2 Each SASS publication includes separate tables with sampling errors for selected estimates included in the 
publication. 

5 For the 1987-88 SASS generalized variance functions (GVFs) see Salvucci and Holt (1992), Generalized Variance 
Estimates for SASS. Also for 1987-88 SASS GVFs see Salvucci, Galfond and Kaufman (1993), “Generalized 
Variance Functions for the Schools and Staffing Surveys,” Proceedings of the Section on Survey Research Methods, 
American Statistical Association. For the 1990-91 SASS generalized variance functions see Salvucci and Weng 



